Nonparametric Reduced Rank Regression
نویسندگان
چکیده
We propose an approach to multivariate nonparametric regression that generalizes reduced rank regression for linear models. An additive model is estimated for each dimension of a q-dimensional response, with a shared p-dimensional predictor variable. To control the complexity of the model, we employ a functional form of the Ky-Fan or nuclear norm, resulting in a set of function estimates that have low rank. Backfitting algorithms are derived and justified using a nonparametric form of the nuclear norm subdifferential. Oracle inequalities on excess risk are derived that exhibit the scaling behavior of the procedure in the high dimensional setting. The methods are illustrated on gene expression data.
منابع مشابه
Nonparametric Reduced-Rank Regression for Multi-SNP, Multi-Trait Association Mapping
Genome-wide association studies have proven to be essential for understanding the genetic basis of disease. However, many complex traits—personality traits, facial features, disease subtyping—are inherently high-dimensional, impeding simple approaches to association mapping. We developed a nonparametric Bayesian reduced rank regression model for multi-SNP, multi-trait association mapping that d...
متن کاملDoubly Decomposing Nonparametric Tensor Regression
Nonparametric extension of tensor regression is proposed. Nonlinearity in a high-dimensional tensor space is broken into simple local functions by incorporating low-rank tensor decomposition. Compared to naive nonparametric approaches, our formulation considerably improves the convergence rate of estimation while maintaining consistency with the same function class under specific conditions. To...
متن کاملHierarchically Compositional Kernels for Scalable Nonparametric Learning
We propose a novel class of kernels to alleviate the high computational cost of large-scale nonparametric learning with kernel methods. The proposed kernel is defined based on a hierarchical partitioning of the underlying data domain, where the Nyström method (a globally low-rank approximation) is married with a locally lossless approximation in a hierarchical fashion. The kernel maintains (str...
متن کاملCointegrating rank selection in models with time-varying variance
Reduced rank regression (RRR) models with time varying heterogeneity are considered. Standard information criteria for selecting cointegrating rank are shown to beweakly consistent in semiparametric RRR models in which the errors have general nonparametric short memory components and shifting volatility provided the penalty coefficient Cn → ∞ and Cn/n → 0 as n → ∞. The AIC criterion is inconsis...
متن کاملApplication of Local Rank Tests to Nonparametric Regression
Let Yi = f(xi) + Ei (1 ≤ i ≤ n) with given covariates x1 < x2 < · · · < xn, an unknown regression function f and independent random errors Ei with median zero. It is shown how to apply several linear rank test statistics simultaneously in order to test monotonicity of f in various regions and to identify its local extrema.
متن کامل